Each score pertains to the combined test set of the language, without distinguishing individual treebanks and the enhancement types they annotate. The last line shows the macro-average over languages.
Language | Tokens | Words | Sentences | UPOS | XPOS | UFeats | AllTags | Lemmas | UAS | LAS | CLAS | MLAS | BLEX | EULAS | ELAS |
Arabic | 99.98 | 97.89 | 80.43 | 95.12 | 0.00 | 92.57 | 0.00 | 93.72 | 85.36 | 81.17 | 78.81 | 72.15 | 75.60 | 79.67 | 77.82 |
Bulgarian | 99.93 | 99.93 | 97.27 | 99.07 | 0.00 | 97.43 | 0.00 | 98.36 | 95.07 | 92.48 | 89.94 | 85.96 | 87.85 | 91.48 | 90.73 |
Czech | 99.90 | 99.90 | 94.26 | 98.60 | 0.00 | 93.91 | 0.00 | 98.12 | 92.94 | 90.83 | 89.39 | 81.25 | 87.53 | 88.97 | 87.51 |
Dutch | 99.87 | 99.87 | 72.58 | 96.26 | 0.00 | 96.12 | 0.00 | 96.67 | 90.02 | 87.20 | 82.33 | 75.95 | 78.84 | 85.90 | 84.73 |
English | 99.37 | 99.37 | 86.77 | 96.63 | 0.00 | 96.52 | 0.00 | 97.14 | 91.13 | 88.97 | 87.15 | 81.45 | 84.71 | 87.84 | 87.15 |
Estonian | 99.74 | 99.74 | 91.75 | 97.18 | 0.00 | 95.64 | 0.00 | 96.65 | 88.62 | 85.86 | 84.61 | 79.01 | 81.40 | 85.12 | 84.54 |
Finnish | 99.70 | 99.68 | 91.72 | 98.24 | 42.70 | 96.60 | 41.17 | 96.29 | 93.96 | 92.50 | 91.65 | 87.11 | 87.60 | 90.18 | 89.49 |
French | 99.65 | 99.42 | 95.23 | 97.28 | 99.42 | 90.44 | 89.49 | 96.41 | 91.26 | 87.85 | 82.94 | 70.36 | 80.07 | 87.26 | 85.90 |
Italian | 99.91 | 99.76 | 98.76 | 98.44 | 0.00 | 98.05 | 0.00 | 98.50 | 94.71 | 93.31 | 90.34 | 86.91 | 88.45 | 92.29 | 91.54 |
Latvian | 99.83 | 99.83 | 99.01 | 97.15 | 0.00 | 93.77 | 0.00 | 96.32 | 91.38 | 88.53 | 86.64 | 77.43 | 82.86 | 85.51 | 84.94 |
Lithuanian | 99.87 | 99.87 | 88.79 | 96.34 | 0.00 | 87.56 | 0.00 | 93.81 | 85.49 | 81.85 | 79.88 | 66.23 | 74.04 | 79.43 | 77.64 |
Polish | 99.41 | 99.82 | 98.35 | 98.50 | 0.00 | 90.04 | 0.00 | 97.84 | 94.38 | 91.82 | 90.36 | 77.36 | 88.11 | 89.94 | 84.64 |
Russian | 99.57 | 99.57 | 98.86 | 98.72 | 99.57 | 97.01 | 96.68 | 98.03 | 94.06 | 92.74 | 91.84 | 88.10 | 89.97 | 91.57 | 90.69 |
Slovak | 99.97 | 99.97 | 90.93 | 97.52 | 0.00 | 91.02 | 0.00 | 96.59 | 93.40 | 91.57 | 90.60 | 77.76 | 86.76 | 89.93 | 88.56 |
Swedish | 99.45 | 99.45 | 94.54 | 97.56 | 0.00 | 88.47 | 0.00 | 93.13 | 90.81 | 88.31 | 87.29 | 71.65 | 80.37 | 86.76 | 85.64 |
Tamil | 99.58 | 91.42 | 95.08 | 84.27 | 0.00 | 79.97 | 0.00 | 86.10 | 64.47 | 59.66 | 57.72 | 47.18 | 53.84 | 59.58 | 57.83 |
Ukrainian | 99.81 | 99.79 | 96.65 | 97.88 | 0.00 | 92.04 | 0.00 | 97.57 | 91.65 | 89.68 | 87.41 | 76.92 | 84.81 | 87.65 | 87.22 |
Average | 99.74 | 99.13 | 92.41 | 96.75 | 14.22 | 92.77 | 13.37 | 95.96 | 89.92 | 87.31 | 85.23 | 76.63 | 81.93 | 85.83 | 84.50 |
The system output for each language was split into parts corresponding to individual source treebanks. The scores then ignore errors in enhancement types for which the treebank lacks gold-standard annotation. The column LAvgELAS shows the qualitative ELAS averaged over treebanks of the same language; the final average in bold is averaged over languages rather than treebanks. For comparison, the last column then shows the coarse ELAS F1 for the given language.
Treebank | Tokens | Words | Sentences | UPOS | XPOS | UFeats | AllTags | Lemmas | UAS | LAS | CLAS | MLAS | BLEX | EULAS | ELAS | Enhancements | LAvgELAS | cf. |
Arabic-PADT | 99.98 | 97.89 | 80.43 | 95.12 | 0.00 | 92.57 | 0.00 | 93.72 | 85.36 | 81.17 | 78.81 | 72.15 | 75.60 | 79.68 | 77.83 | (no xsubj) | 77.83 | 77.82 |
Bulgarian-BTB | 99.93 | 99.93 | 97.27 | 99.07 | 0.00 | 97.43 | 0.00 | 98.36 | 95.07 | 92.48 | 89.94 | 85.96 | 87.85 | 91.48 | 90.73 | 90.73 | 90.73 | |
Czech-FicTree | 99.98 | 99.93 | 92.29 | 96.99 | 0.00 | 78.70 | 0.00 | 97.13 | 92.00 | 89.43 | 87.51 | 56.45 | 84.16 | 87.49 | 85.89 | 85.93 | 87.51 | |
Czech-CAC | 99.99 | 99.98 | 97.12 | 97.92 | 0.00 | 92.81 | 0.00 | 97.42 | 93.03 | 90.35 | 88.78 | 79.95 | 86.59 | 87.54 | 85.75 | 85.93 | 87.51 | |
Czech-PDT | 99.97 | 99.97 | 94.17 | 98.99 | 0.00 | 95.61 | 0.00 | 98.49 | 93.26 | 91.38 | 90.03 | 84.01 | 88.38 | 89.51 | 88.17 | 85.93 | 87.51 | |
Czech-PUD | 99.15 | 99.15 | 95.85 | 96.77 | 0.00 | 92.34 | 0.00 | 96.03 | 90.84 | 87.29 | 85.30 | 76.36 | 82.84 | 86.12 | 83.90 | (no codepend) | 85.93 | 87.51 |
Dutch-Alpino | 99.96 | 99.96 | 89.98 | 97.11 | 0.00 | 97.06 | 0.00 | 97.37 | 93.42 | 90.89 | 87.14 | 81.29 | 83.70 | 89.77 | 88.47 | 84.81 | 84.73 | |
Dutch-LassySmall | 99.78 | 99.78 | 58.55 | 95.45 | 0.00 | 95.22 | 0.00 | 96.00 | 86.77 | 83.67 | 77.87 | 71.00 | 74.35 | 82.20 | 81.16 | 84.81 | 84.73 | |
English-EWT | 99.01 | 99.01 | 81.14 | 96.66 | 0.00 | 96.90 | 0.00 | 97.66 | 89.90 | 87.81 | 85.49 | 81.55 | 84.15 | 86.71 | 86.14 | 87.25 | 87.15 | |
English-PUD | 99.80 | 99.80 | 97.91 | 96.61 | 0.00 | 96.08 | 0.00 | 96.52 | 92.59 | 90.34 | 89.25 | 81.32 | 85.41 | 89.16 | 88.35 | 87.25 | 87.15 | |
Estonian-EDT | 99.96 | 99.96 | 93.32 | 97.73 | 0.00 | 96.24 | 0.00 | 97.10 | 89.73 | 87.14 | 85.93 | 80.68 | 82.88 | 86.83 | 86.34 | (no xsubj) | 81.26 | 84.54 |
Estonian-EWT | 98.65 | 98.65 | 82.41 | 94.53 | 0.00 | 92.77 | 0.00 | 94.46 | 83.31 | 79.73 | 78.16 | 70.93 | 74.21 | 77.17 | 76.18 | (no codepend, no xsubj) | 81.26 | 84.54 |
Finnish-TDT | 99.77 | 99.73 | 93.05 | 98.37 | 0.00 | 96.48 | 0.00 | 96.43 | 93.98 | 92.62 | 91.84 | 87.07 | 87.87 | 89.86 | 89.24 | 89.55 | 89.49 | |
Finnish-PUD | 99.60 | 99.60 | 89.74 | 98.06 | 99.60 | 96.75 | 96.03 | 96.10 | 93.94 | 92.34 | 91.40 | 87.17 | 87.26 | 90.65 | 89.86 | (no codepend, no xsubj) | 89.55 | 89.49 |
French-Sequoia | 99.90 | 99.58 | 88.79 | 98.75 | 99.58 | 97.05 | 96.61 | 98.70 | 93.48 | 92.06 | 89.62 | 85.05 | 88.60 | 90.83 | 90.58 | (no gapping, relcl, case) | 87.65 | 85.90 |
French-FQB | 99.55 | 99.36 | 96.48 | 96.67 | 99.36 | 87.69 | 86.52 | 95.46 | 90.34 | 86.10 | 80.19 | 64.30 | 76.55 | 85.65 | 84.72 | (no gapping, relcl, case) | 87.65 | 85.90 |
Italian-ISDT | 99.91 | 99.76 | 98.76 | 98.44 | 0.00 | 98.05 | 0.00 | 98.50 | 94.71 | 93.31 | 90.34 | 86.91 | 88.45 | 92.29 | 91.54 | 91.54 | 91.54 | |
Latvian-LVTB | 99.83 | 99.83 | 99.01 | 97.15 | 0.00 | 93.77 | 0.00 | 96.32 | 91.38 | 88.53 | 86.64 | 77.43 | 82.86 | 85.51 | 84.94 | 84.94 | 84.94 | |
Lithuanian-ALKSNIS | 99.87 | 99.87 | 88.79 | 96.34 | 0.00 | 87.56 | 0.00 | 93.81 | 85.49 | 81.85 | 79.88 | 66.23 | 74.04 | 79.43 | 77.64 | 77.64 | 77.64 | |
Polish-LFG | 97.68 | 99.86 | 98.55 | 98.09 | 0.00 | 72.85 | 0.00 | 98.17 | 93.00 | 88.54 | 87.15 | 52.01 | 85.22 | 87.17 | 71.40 | (no gapping) | 82.36 | 84.64 |
Polish-PDB | 99.87 | 99.83 | 98.39 | 98.84 | 0.00 | 94.74 | 0.00 | 98.03 | 94.73 | 92.76 | 91.36 | 84.20 | 89.28 | 90.65 | 87.89 | 82.36 | 84.64 | |
Polish-PUD | 99.80 | 99.77 | 97.91 | 98.16 | 0.00 | 93.70 | 0.00 | 97.26 | 94.71 | 92.44 | 90.77 | 82.61 | 88.01 | 90.55 | 87.80 | 82.36 | 84.64 | |
Russian-SynTagRus | 99.57 | 99.57 | 98.86 | 98.72 | 99.57 | 97.01 | 96.68 | 98.03 | 94.06 | 92.74 | 91.84 | 88.10 | 89.97 | 91.57 | 90.69 | 90.69 | 90.69 | |
Slovak-SNK | 99.97 | 99.97 | 90.93 | 97.52 | 0.00 | 91.02 | 0.00 | 96.59 | 93.40 | 91.57 | 90.60 | 77.76 | 86.76 | 89.93 | 88.56 | 88.56 | 88.56 | |
Swedish-Talbanken | 99.97 | 99.97 | 98.85 | 98.84 | 0.00 | 97.37 | 0.00 | 98.01 | 93.84 | 91.96 | 90.68 | 85.90 | 88.04 | 90.21 | 89.12 | 85.50 | 85.64 | |
Swedish-PUD | 98.89 | 98.89 | 89.43 | 96.19 | 0.00 | 78.95 | 0.00 | 87.90 | 87.58 | 84.41 | 83.67 | 56.46 | 72.19 | 83.04 | 81.89 | 85.50 | 85.64 | |
Tamil-TTB | 99.58 | 91.42 | 95.08 | 84.27 | 0.00 | 79.97 | 0.00 | 86.10 | 64.47 | 59.66 | 57.72 | 47.18 | 53.84 | 59.48 | 57.73 | (no gapping, xsubj, relcl) | 57.73 | 57.83 |
Ukrainian-IU | 99.81 | 99.79 | 96.65 | 97.88 | 0.00 | 92.04 | 0.00 | 97.57 | 91.65 | 89.68 | 87.41 | 76.92 | 84.81 | 87.65 | 87.22 | 87.22 | 87.22 | |
Average | 99.63 | 99.31 | 92.13 | 96.97 | 14.22 | 92.10 | 13.42 | 96.19 | 90.57 | 87.94 | 85.90 | 75.96 | 82.64 | 86.36 | 84.63 | 84.19 |